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Abstract 

We consider the transmission of a memoryless bivariate Gaussian source over 
' an average-power-constrained one-to-two Gaussian broadcast channel. The trans- 

mitter observes the source and describes it to the two receivers by means of an 
average-power-constrained signal. Each receiver observes the transmitted signal 
corrupted by a different additive white Gaussian noise and wishes to estimate the 
■ source component intended for it. That is, Receiver 1 wishes to estimate the first 

source component and Receiver 2 wishes to estimate the second source compo- 
nent. Our interest is in the pairs of expected squared-error distortions that are 
I simultaneously achievable at the two receivers. 

We prove that an uncoded transmission scheme that sends a linear combination 
of the source components achieves the optimal power-versus-distortion trade-off 
whenever the signal-to-noise ratio is below a certain threshold. The threshold is a 
function of the source correlation and the distortion at the receiver with the weaker 
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noise. 
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^ ! 1 Introduction 

!>■ 

^T) . We consider the transmission of a memoryless bivariate Gaussian source over an average- 

*^ I power-constrained one-to-two Gaussian broadcast channel. The transmitter observes 

the source and describes it to the two receivers by means of an average-power-constrained 
. signal. Each receiver observes the transmitted signal corrupted by a different additive 

I white Gaussian noise and wishes to estimate the source component intended for it. That 

is, Receiver 1 wishes to estimate the first source component and Receiver 2 wishes to 
, ■ estimate the second source component. Our interest is in the pairs of expected squared- 

[ error distortions that are simultaneously achievable at the two receivers. 

' We prove that an uncoded transmission scheme that sends a linear combination of 

the source components achieves the optimal power-versus-distortion trade-off whenever 
the signal-to-noise ratio is below a certain threshold. The threshold is a function of the 
source correlation and the distortion at the receiver with the weaker noise. 

This result is reminiscent of the results in [H [2] about the optimality of uncoded 
transmission of a bivariate Gaussian source over a Gaussian multiple-access channel, 
without and with feedback. There too, uncoded transmission is optimal below a certain 
SNR-threshold. This work is also related to the classical result of Goblick [3], who 
showed that for the transmission of a memoryless Gaussian source over the additive 
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white Gaussian noise channel, the minimal expected squared-error distortion is achieved 
by an uncoded transmission scheme. It is also related to the work of Gastpar [4J who 
showed for some combined source-channel coding analog of the quadratic Gaussian 
CEO problem that the minimal expected squared-error distortion is achieved by an 
uncoded transmission scheme. 



2 Problem Statement 

Our setup is illustrated in Figure [H It consists of a memoryless bivariate Gaussian 
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Figure 1: Two-user Gaussian broadcast channel with bivariate source. 

source and a one-to-two Gaussian broadcast channel. The memoryless source emits at 
each time /c E Z a bivariate Gaussian (^i^^, S2^k) of zero mean and covariance matriji0 



1 P 
P 1 



where p G [0, 1). 



(1) 



The source is to be transmitted over a memoryless Gaussian broadcast channel with 
time-A; input Xk G M, which is subjected to an expected average power constraint 



(2) 



fc=i 



for some given P > 0. The time-A; output ^ at Receiver i is given by 

yi,k = Xk + Zi^k «G{1,2}, 

where Zjjt is the time-A; additive noise term on the channel to Receiver i. For each 
i G {1,2} the sequence {Zi^k^kLi is independent identically distributed (IID) M{0,Ni) 
and independent of the source sequence {(5*1^^,52,^)}, where M^fi^"^) denotes the 
mean-/x variance-j^^ Gaussian distribution and where we assume thato 



(3) 



For the transmission we consider block encoding schemes where, for blocklength n, 
the transmitted sequence X = {Xi, X2, ■ ■ ■ , Xn) is given by 



X = /(")(Si,S2), 



(4) 



Var(S2 



will be 



^The restrictions made on Kss, i.e., that p £ [0, 1) and that Var(5'i,fc) 
justified in Remark 12.21 once the problem has been stated completely. 

^The case A^i = N2 is equivalent to the problem of sending a bivariate Gaussian on a single-user 
Gaussian channel [T]. 
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for some encoding function : x M" M", and where we use boldface characters 
to denote n-tuples, e.g. Si = {Si^i, Si^2, ■ ■ ■ , Si^n)- Receiver z's estimate Sj of the source 

(n) 

sequence Sj intended for it, is a function cp- : M" of its observation Yj, 



(Y,) ie{l,2}. (5) 



The quahty of the estimate Sj with respect to the original source sequence Sj is mea- 
sured in expected squared-error distortion averaged over the blocklength n. We denote 

(n) 

this distortion by 5 , i.e. 



* n 

k=l 



^-Y,^[iS^,k-S^,k?] iG{l,2}. (6) 



Our interest is in the set of distortion pairs that can be achieved simultaneously at 
the two receivers as the blocklength n tends to infinity. This notion of achievability is 
described more precisely in the following definition. 

Definition 2.1 (Achievability). Given cr^ > 0, p G [0,1), P > and < A^i < N2, 

we say that the tuple {Di, D2,<t'^ , p, P, Ni, N2) is achievable (or in short, that the pair 
{Di,D2) is achievable) if there exist a sequence of encoding functions {/^"'^} as in (jH) 
satisfying the average power constraint ([2]) and sequences of reconstruction functions 
{ </>^"''* } , { 02™^ } as in ([5]) with resulting average distortions 5^"^ , as in ([6]) that fulfill 

lh^5f^<A iG{l,2}, 

n— >oo 

whenever 

Yi = /W(Si,S2) + Z, ie{l,2}, (7) 

for {(5*1^^,52,^)} an IID sequence of zero-mean bivariate Gaussians with covariance 
matrix as in ([T]) and {•^i,fe}^i IID zero-mean Gaussians of variance Ni, i G {1,2}. 

Based on Definition 12.11 we next define the set of all achievable distortion pairs. 

Definition 2.2 (^(cr^, p, P, Ni,N2)). For any cr^, p, P, Ni, and N2 as in Definition O 
we define &{(t'^ , p, P, Ni, N2) (or just as the region of all pairs {Di,D2) for which 
{Di, D2,(j'^ , p, P, Ni, N2) is achievable, i.e. 

^{a\p,P,Ni,N2) = {{Di,D2) : {Di, D2,a'^ , p, P, Ni, N2) is achievable}. 



Remark 2.1. The region ^ is closed and convex. 

Proof. See Appendix lA.li □ 

Remark 2.2. In the description of the source law in ([1]), we have excluded the case 
where p = 1- We have done so because for this case the optimality of uncoded trans- 
mission follows immediately for all SNRs from the corresponding result for the single 
user scenario in [3]. Moreover, we have also assumed that the source components are 
of equal variance and that their correlation coefficient p is nonnegative. We now show 
that these two assumptions incur no loss in generality. 
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i) We can limit ourselves to nonnegative correlation coefficients p because the 
distortion region & depends on the correlation coefficient only via its absolute 
value \p\. That is, the tuple {Di, D2,(t'^ , p, P, Ni, N2) is achievable if, and only 
if, the tuple {Di, D2, a"^ , —p, P, Ni, N2) is achievable. To see this, note that if 
{f^'^\4'^^\4)^^} achieves the distortion {Di,D2) for the source of correlation 
coefficient p, then {/|"\ (^["^ ^2"^}, where 

/(")(Si,S2) = /("■)(-Si,S2) and ,^S")(Y) = -^"^(Y) 
achieves {Di,D2) for the source with correlation coefficient —p. 

ii) The restriction to source components of equal variances incurs no loss of gener- 
ality because the distortion region scales linearly with the variance of the source 
components. To see this, consider the more general case where the two source 
components are not necessarily of equal variances, i.e., where Var(5'i^fc) = 
and Var(S'2^fc) = a 2 for some o"^, a"| > and for all A: G Z. Accordingly, define a 
tuple (-Di, D21 ) cr|, p, P, A^i, A'2) to be achievable, similarly as in Definiton l2.ll 
The proof now follows from showing that the tuple (-Di, D21 ) p, P, Ni, N2) 
is achievable if, and only if, for every ai,a2 G M"*", the tuple {aiDi, a2D2, aiaf, 
a2cr2,p, P, Ni,N2) is achievable. This can be seen as follows. If {/("), 4"^} 
achieves the tuple (Di, -D2, f^, cr^, p,P,Ni,N2), then (^^"■'} where 

/»(S„S2) = /(") f-^,-^), 

and where 

achieves the tuple {aiDi,a2D2,aiaf ,02(^2, p, P, Ni, N2). And by an analogous 
argument it follows that if {aiDi, a2D2,aiai, 02(72, p, P, Ni, N2) is achievable, 
then also {Di , D2,crl, a2, p, P, Ni, N2) is achievable. 

We state one more property of the region ^. To this end, we need the following 
two definitions. 

Definition 2.3 (-Dj^min)- We say that Di is achievable if there exists some D2 such 
that {Di, D2) £ The smallest achievable Di is denoted by -Di,min- The achievability 
of D2 and the distortion -D2,min are analogously defined. 

By the classical single-user result f5] Theorem 9.6.3, p. 473] 

Definition 2.4 (D*(L'2) and D^iDi)). For every achievable D2, we define D*(L'2) as 
the smallest D[ such that {D[,D2) is achievable, i.e., 

Dl{D2)^mm{D[ : {D[,D2) G ^} . 

Similarly, 

D*2{Di)^mm{D'2 : (Di,Z)^) G i^} . 
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In general, we have no closed-form expression for -D|(-) and D'2{-). However, in the 
following two special cases we do: 

Proposition 2.1. The distortion -Di(-D2,min) is given by 

Dl{D2,mm) = cr ^vT+P ' 



The distortion pair (I?*(I?2,min)5 ^2,min) is achieved by setting Xk = \/P/o^S2,k- 
Proof. See Appendix [X2l □ 
Proposition 2.2. The distortion D2(-^i,min) is given by 

£'2(^l,minj = cr jy^ ^ p ' 



The distortion pair (Di.mini -D2(-Di,mm)) is achieved by setting Xk = \J P/a'^Si^k- 

Proof. The value of -Dll-^i.min) follows from Theorem 13.11 ahead as follows: For Di = 
Di. min it can be verified that condition (I13p of Theorem 13.11 is satisfied for all P/Ni . 
Hence, the pair (-Di,min, -C|(-Di,min)) is always achieved by the uncoded scheme with 
a = 1, /3 = 0, and so 

(This remark will not be used in the proof of Theorem 13.11 ) 

3 Main Result 

Our main result states that, below a certain SNR-threshold, every pair {Di,D2) G & 
can be achieved by an uncoded scheme, where for every time-instant 1 < k < n, the 
channel input is of the form 



P 



X^ia,P) = \l 2 , ^^^^ , ^^, {aSi,k + pS2,k), (10) 



for some a, /? G M. The estimate S^j^ of Si^^ (at Receiver i), i £ {1, 2}, is the minimum 
mean squared-error estimate of Si^k based on the scalar observation 1^ fc, i.e.. 

We denote the distortions resulting from this uncoded scheme by and They 
are given by 

^^ 2 P^PH^ -P^)+ PNija' + 2a(3p + 0^2- p^)) + iVf (g^ + 2a(5p + f3^) 
^^"'^^ (P + iVi)2(a2 + 2a/5p + /32) ^^'^^ 

2 P^c^{l - p") + PN2{a'{2 - p") + 2a[3p + /?^) + iV|(a^ + 2a/3p + (3^) 
'^"'^^ {P + N2na^ + 2a(3p + P^) 
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Remark 3.1. In the reminder, we shall limit ourselves to transmission schemes with 
a G [0, 1] and /3 = 1 — a. This incurrs no loss in optimality, as we next show. For p > 0, 
an uncoded transmission scheme with the choice of (a, /3) such that a/3 < 0, yields 
a distortion that is uniformly worse than the choice (|a|,|/?|). Thus, without loss in 
optimality, we can restrict ourselves to a, /3 > 0. It remains to notice that for a, f3 >0, 
the channel input X^{a,f3) depends on a, [5 only via the ratio a/ [5. 

Our main result can now be stated as follows. 

Theorem 3.1. For every {Di,D2) £ 'Si and 

^^<T{Di,a^,p), (13) 

there exist a*, [5* > such that 

^i(a*,/3*) < -Di and D^{a* , (3*) < D2, 
where the threshold T is given by 

T{D,,a\p) = \ TM^HT^T^TdT) 0<D,<a {1-p), 

I +00 otherwise. 

Proof. See Appendix [Bl □ 

For < Di < o"2(l — p^) the threshold function satisfies F > 2/9/(1 — p) where 
equality is satisfied for Di = a'^{l — p). Thus a weaker, but simpler, form of Theorem 
[Qis 

Corollary 3.1. // 

then any (Di, D2) £ S is achievable by the uncoded scheme, i.e. for every {Di,D2) € S 
there exist some a* , (3* > such that 

D'l{a* , ^*) < Di and D^{a* , P*) < D2. 



4 Summary 

We studied the transmission of a memoryless bivariate Gaussian source over an average- 
power-constrained one-to-two Gaussian broadcast channel. In this problem, the trans- 
mitter of the channel observes the source and describes it to the two receivers by means 
of an average-power-constrained signal. Each receiver observes the transmitted signal 
corrupted by a different additive white Gaussian noise and wishes to estimate one of the 
source components. That is, Receiver 1 wishes to estimate the first source component 
and Receiver 2 wishes to estimate the second source component. Our interest was in 
the pairs of expected squared-error distortions that are simultaneously achievable at 
the two receivers. 

For this problem, we presented the optimality of an uncoded transmission scheme 
for all SNRs below a certain threshold (see Theorem 13. ip . A weaker form of this result 
(see Corollarv l3.ip is that if the SNR on the link with the weaker additive noise satisfies 

I_ < 

Ni- 1-p' 

then every achievable distortion pair is achieved by the presented uncoded transmission 
scheme. 
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A Proof of Remark 12.11 and Proposition 12.11 

A.l Proof of Remark 

The convexity of S! follows by a time-sharing argument. This technique is demonstrated 
in [6l Proof of Lemma 13.4.1, pp. 349]. 

We now prove that Q is closed. To this end, let \^yD\\^^^^ {i,L'2}^i be sequences 
satsifying [vD\,y D2) G ^, for all u G N+, and satisfying 

lim^A = A ^e{i,2}, 

l/—KX> 

for some Di, D2 G M. To show that ^ is closed we need to show that {Di, D2) G ^. We 
construct a sequence of schemes achieving (£'1,1)2) as follows. Since {uDi,^ D2) G ^, 
it follows that there exists a monotonically increasing sequence of positive integers 
such that for all n> there exists a scheme [f!) , (f'l^l: 4^^2u) satisfying 



1 " 

k=l 

-Y.^[{S2,k-S2,k? 



< vDi + -, 

V 



< uD2 + -. 

V 



Since is increasing in z/, we now choose our sequence of schemes to be {/j^"^}, {'/'i"!^}) 
{^2^1! } fo'^ all n G [n!y,njy+i) and v G N+. This sequence of schemes satisfies 



im - V'E (S'l fc - ^i^fc)^ 
-^00 n ^-^ L 
fe=i 

\Y,^\{S2,k-S2,k? 



lim 

n— >oo Ji 



<D2, 



so, by Definition 12.11 the pair {Di,D2) is achievable, i.e., in 



(15) 
(16) 
□ 



A. 2 Proof of Proposition 12. II 

To prove Proposition 12.11 we derive a lower bound on -D]'(-D2,min) and then show that 
this lower bound is achieved by the uncoded scheme. To this end, let 

Wi^Si-pS2, (17) 

and note that Wi is independent of 82. The key to the lower bound is that for any 
sequence of schemes achieving -D2,min) the amount of information that Yi can contain 
about Wi must vanish as n — > 00. This will be stated more precisely later on. 

Let {f^'^\4>^(^\(f>^2^^} be some sequence of coding schemes achieving the distortion 

min in the sense that 

m 4"^ = ^2,min, (18) 

where and are as in 1^. Let X be the channel input associated with this 
coding scheme, and let Yi be the resulting n-tuple received by Receiver 1. 
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(n) 

We now lower bound 6\ using the relation Si = Wi + pS2- From this relation it 
follows that the optimal estimator, for 1 < k < n, is 

E[Si,k\Yi] = E[Wi,k + pS2,k\^i] 

= E[Tyi,,.|Yi]+/5E[52,A:|Yi]. 

(n) 

Since (pl cannot outperform the optimal estimator, 

k=l 
1 " 

= - E E [(W^i.fc + pS2,k - E[Wi,fc|Yi] - pE[S2,k\Yi]f] 

k=l 

n n 

= E E [(^2,. - E[52,fc|Yi])2] + - E E [(^1,;^ - mi,k\Yi]f] 

k=l k=l 

1 " 

+ 2p- ^[iWi,k - E[T^i,fc|Yi])(52,fc - E[52,fc|Yi])] . (19) 
fc=i 

We now lower bound the three terms on the RHS of (1191 ). For the first term we have 

) 



1 " 

- 5^ E [(^2,, - E[S2MYi]f] > a22-^^(«^^^^ 



n 
k=l 



where the first inequality follows by rate-distortion theory, the second inequality by the 
data processig inequality, and the third because the IID Gaussian input maximizes the 
mutual information. 

To bound the second term in (llOp we use the following lemma. 

Lemma A.l. For any sequence of schemes achieving -D2,min in the sense of (llSp and 
any e > there exists an integer such that for all n > n^, 

/(W.;YO<=log,(i±^), (21) 

where Wi is defined in p!7|) and Yi is the n-tuple received by Receiver 1 when this 
scheme is used. 

Proof See Appendix [AXTl □ 

We now have 



n 
k=l 



>a2(l-p2)^i vn>n„ (22) 

where the first inequality follows from rate-distortion theory (because Wi^k is AA(0, cr^(l — 
and the second inequality follows by Lemma lA.ll 

The third term in (llOp is lower bounded in the following lemma. 
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Lemma A. 2. 



^ ^ E[iW,,k - E[W,,k\YMS2,k - E[52,fc|Yi])] > -Jj^^ ■ ^- (23) 
fc=i 

Proof. See Appendix lA. 2. 21 □ 
Combining the bounds in (j20p . (|22p and (j23p with the bound in (|19p gives 



> <T (1 - p )-r^— - 2pJ —— -a + a p 



iVi + e Ni + e ^ Ai + P 

Taking the hmit inferior as n — > oo (with e > held fixed), and then letting e tend to 
zero, gives 

2Ai + P(l-/>2) 



lim > a „ 

- Ni + P 



and hence. 



n*m w ,2 ^i+-P(l-/>') 



Since the RHS of (p^ is achieved by the uncoded scheme with a = 0, /3 = 1, it follows 
that must hold with equality, i.e., that 

Di{D2,mm) = O- N^^p • (^^) 

A. 2.1 Proof of Lemma lA.ll 

The key element to the proof of Lemma lA.ll is the following lemma. 

(n) 

Lemma A. 3. Any scheme resulting in the distortion 82 at Receiver 2, must produce 
a Yi satisfying 

/(S.;V.|S.)<|log7 '^ + ^-"tV-^- + ^' ). (20) 



Proof. We first notice that 

/(Si; Y1IS2) = MY1IS2) - /i(Yi|Si,S2) 
= /i(Yi|S2)-/i(Zi) 

= /i(Yi|S2)--log2(2^eAi). (27) 

To upper bound /(Si; Y1IS2) it thus suffices to upper bound /i(Yi|S2). To this end, 
we first upper bound /i(Y2|S2) by means of rate-distortion theory, and then deduce 
an upper bound on /i(Yi|S2) by means of a conditional version of the entropy power 
inequality. 

We denote the rate-distortion function for S2 by Rs2{') so that 

1. fa^ 



/i5,(A2) = -log2(^), 



9 



for any A2 > 0. Hence, 



</(S2;S2) 
</(S2;Y2) 

= MY2)-MY2|S2) 

77 

< -log2(27re(P + iV2))-/i(Y2|S2). (28) 



Rearranging (|28|) gives 

/i(Y2|S2) < - log2 (27re(P + N^)) - - \og^ ( ^ 



-"2 



(n)- 

log2 (2^e(P + iV2)^ I . (29) 



n 



Based on (j29|) we now deduce an upper bound on /i(Yi|S2). To this end, we first 
notice tliat for a sequence {-^2 fci ~ -^(0) -^1 — ^2) and independent of 

(Yi, S2), we have that 

/l(Y2|S2) = /i(Yi + Z'2|S2). 

Hence, by a conditional version of the entropy power inequahty [El Inequahty (17)] it 
follows that 

>2lMYi|S2)^2i'^(2'2) 

= 2l'^(Yi|S2) + 27re(iV2-A^i)- 



And thus, 



2^MYi|S2) < 2^MY2|S2) _ 2^e{N2 - N,) 

< 27re(P + N2)^ - 2^e(iV2 - Ni) 

( ^("^ \ 

= 27re (P + iV2)^-iV2 + iVi , (30) 

where in the second inequality we have used ([29|) . Combining ([30]) with (p7|) gives 

/(Si;Yi|S2) < ^log2 U-Ke [(P + A^2)^ - A^2 + A^i] ] - ^ log2 (2^eiVi) 



2 iVi i 



The proof of Lemma lA.ll now follows easily. 
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Proof of Lemma \A.ll The proof only requires applying Lemma IA.3I to a sequence of 
schemes achieving L>2,min- For such a sequence of schemes and for any e > there 
exists an integer such that for all n>n^ 

O2 < ^2,mm + — ^ — <7 



N2 + P N2+P 



(31) 



By Lemma lA.31 



4"^ < a- 



N2 + e 
N2 + P 



n 



/(Si;Yi|S2) < -log2 



e + iVi 



And since /(Si;Yi|S2) > /(Si -pSsiYi) =/(Wi;Yi), we obtain 

V 2 - N2 + PJ 

Combining (|32]l with (f3T]l concludes the proof. 



A.2.2 Proof of Lemma [AT2] 

We first simplify the original expectation expression 
1 " 

- Y^E[{Wi,k - E[l^i,fc|Yi])(52,fc - E[52,fc|Yi])] 



(/(w.Y,,^iog2(i±;^l 



(32) 
□ 



k=l 



a) 1 

n 



- VE[(P7i,fc-E[VFi,fc|Yi])52,, 

A:=l 
1 

- VE[E[VFi,fc|Yi]52,fc] 



n 



k=l 



1 



fc=l 



^-;iE\/^iE[w^i,,|Yir 



5: 



2,fc 



> 




\ k=l 



1 " 

^ fc=l 



(33) 



where a) follows since E[S'2,fc|Yi] is a function of Yi and hence is independent of 
(^i,fc — E[H^i fc|Yi]), and h) follows since Wi^k is independent of £'2,^. The remaining 
square-root can now be bounded by means of (j22p : 



k=i 



e + Ni ~ n 

= ^ E E [Wlk] - 2^ E E[^i,^E[H^i,,|Yi]] + 1 5^ E [e[T^i,,|Yi] 

fc=l A;=l 

fc=i fe=i 

n ^-^ L 



k=l 

n 



k=l 



(34) 
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where a) follows since 



Wi,kE[Wi,k\Yi 



which holds by the orthogonality principle of the optimal reconstructor. Hence, rear- 
ranging ([Mj) gives 



< 



iVi + e' 



k=l 

Using this in ([33]) . finally gives 
1 " 

- E[(^i,fc - E[^i,fc|Yi])(52,fc - E[S2,fc|Yi])] > 



k=l 



a. 



□ 



B Proof of Theorem D 

To prove Theorem 13. II we need several preliminaries. Those are stated now. 
Remark B.l. Theorem 13. II is easily verified for (D^jDg) ^ ^ satisfying 

2iVi + P(l-p2) 



D[ > a' 



Ni + P 



(35) 



To prove Theorem 13.11 for such pairs {D[,D2), we simply show that for all P/Ni > 0, 
every (L'^jDg) ^ ^ satisfying ([35]) is achieved by the uncoded scheme. To see this, 
first note that by the definition of D2 mim 



D'2 > -D2,mirn 

whenever {D[,D2) G Also, by Proposition 12.11 

,iVi + P(l-p2) 



(36) 



Dl{D2,min) = (t' 



Ni + P 



so, for {D[,D2) G & satisfying 



D'l > Dl{D2,mh 



(37) 



By Proposition 12.11 the pair (-D^ (-^2,min); -D2,min) is achieved by the uncoded scheme, 
and hence by ([36]) & ([37]) the same must be true for any pair {D[, D2) G S> satisfying 
([35]). 



In view of Remark IB. II we shall assume in the rest of the proof that D\ satisfies 

oiVi+P(l-p2) 

Next, we define ^'^(-Di) as the least distortion that can be achieved in estimating 
S2 at Receiver 1 (!) subject to the constraint that Receiver 1 achieves a distortion Di 
in estimating Si. More precisely: 
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Definition B.l (Z)2(-Di)). For every Di > Di^mirn we define L'^l-^i) ^ 

D*2{Di) = m{{D2}, 

where the infimum is over all D2 to which there correspond average-power limited 
encoders {/^"^} and reconstructors {^i"^}, {^2^^} satisfying 



lim - V'Er(S'i A,. - Si^k 

n— >oo n ^ — ^ L 

k=l 

1 " 

lim - E (52,fc - S2,k 



< D 



1) 



n— s-oo n 

k=l 



< Do 



~(n) 

where 4>2 ■ Yi S2 is any estimator of S2 based on Yi, where X is the result of 
applying to (Si, S2), and where Yi is the associated n-tuple received by Receiver 1. 

Remark B.2. The distortion D2{Di) is the unique solution to the equation 

Rs„s.ADi,D*2{Di)) = ilog2 (1 + ^) ' (39) 

where -Rsi,S2(t) denotes the rate-distortion function on the pair 81,82 when it is 
observed by a common encoder, i.e. 

/?Si,S2(Ai, ^2) = min /(S'i,52;ri,r2). 

Pti,T2\Si,S2'- 

E[(5i-Ti)2]<Ai 

E[(52-T2)2]<A2 

The next proposition gives the explicit form of DKDi) for the cases of interest to us. 

Proposition B.l. Consider transmitting the bivariate Gaussian source ([T]) over the 
AWGN channel that connects the transmitter to Receiver 1. For any Di satisfying (j38p 
and P/Ni satisfying (jlSp . the distortion D2{Di) is given by 

f)*(j^^ 2 ^'«'(1 - P') + m(a'(2 - p^) + 2af3p + p^) + iVf (g^ + 2aPp + P^) 
^' {P + Nif{a^ + 2al3p + (3^) 

(40) 

where a,P are such that D^{a,f3) = Di. Moreover, the pair (Di, D2{Di)) is achieved 
by the uncoded scheme with the above choice of a and (3. 

Proof. For any Di satisfying (f38ll and P/Ni satisfying (fT3]) . let C denote the RHS of 
([30|) with a, j3 satisfying D^{a, (5) = Di. Using the explicit form of Rs^,S2{'^ ")> ^ given 
in P Equation (10)], we obtain that i^^^ ,^2 (-^i , C) equals the RHS of ([39]). Thus, by 
Remark (jB?2]) it follows that Dl{Di) = Q. Moreover, by ^ and our definition of it 
follows that Q = 02(0, P) where a,/3 are such that D^{a,P) = Di. Thus, {Di, (), i.e., 
{Di, D2{Di)) is achieved by the uncoded scheme with that choice of a,/3. □ 

The heart of the proof of Theorem 13.11 is given in the following lemma. It char- 
acterizes the trade-off between the reconstruction fidelity Di at Receiver 1 and the 
reconstruction fidelity D2 at Receiver 2. 
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Lemma B.l. If the pair {Di,D2) G & satisfies ([55]) . and if P/Ni satisfies ([IB]) , then 
for all real numbers ai,a2 of equal sign, 

D2>^iDi,ai,a2), (41) 

where 

nS.a.a,) = ^('^%^ + N,-NX (42) 

P + N2\ 77(0,01,02) J 

and where 



7]{5, 01, 02) =a'- ax(a' - -5)(2 - oi) - a2a^(2p - 02) + 20102^(^2 - 5)(cj2 - D*), 

where we have used the shorthand notation D2 for 02(6), which is given explicitly in 
Proposition \B.li 

Proof See Appendix IB. 1[ □ 

We are now ready to prove Theorem 13. 1[ 

Proof of Theorem \3.1\ By Lemma fB.ll it remains to verify that there exist real numbers 
oi, 02 of equal sign such that (I?i, \I'(Z)i, oi, 02)) coincides with the distortions achieved 
by the uncoded scheme. To this end, consider 



, (43) 

{a^ - D,)Dl{D,) 



pa^-J{a^-D,){a^-D*{D,)) 
at = ^- = . (44) 

We first show that a\, 02 are both nonnegative, and thus indeed of equal sign. That a\ 
is nonnegative follows from (|43p by noting that 



Ni+P P + Ni 



where the upper bound on Di is the one assumed in (j38|) . and the lower bound on 
D2 follows by the classical single-user result Theorem 9.6.3, p. 473]. To show that 
02 is nonnegative, we distinguish between two cases. If Di £ (o"2(l — p'^),a'^], then 
the nonnegativity follows directly from (I44p and from the fact that < 1)2(^1) — 
Otherwise, if Di £ (0, cr^{l — p^)], then the nonnegativity of 02 follows from (IM|), using 
the inequality 



D*2iD^)>{a\l-p')-D,)^—, 



an inequality which can be established using ([39|) . the explicit form of Rsi,S2i'r) [D 
Equation (10)], and the assumption that P/Ni satisfies (USD- 

Having established that and Og are of equal sign, the proof now follows from 
Lemma TB. II bv verifying that if {Di,D2) G & satisfies and if P/Ni satisfies 
then choosing (a,/3) so that D"(a,/3) = Di results in D2{a,P) satisfying 

D^{a,(3) =^{Di,al,a*2). □ 
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B.l Proof of Lemma IB. II 

To prove Lemma iB.ll we begin with a reduction. 

Reduction B.l. To prove Lemma IB. II it suffices to consider pairs {Di,D2) G that 
are achievable by coding schemes that achieve Di with equahty 

1 " 

^ - y2^\iSi,k-Si,k?]=D,, (45) 

n^oo n — ' L 
fc=l 

and for which 

0S")(Y,) = E[Si|Yi] iG{l,2}. (46) 

The proof of Reduction IB.ll is based on the following lemma. 

Lemma B.2. Any sequence of schemes achieving some boundary point (Di, D2{Di)) 
where Di satisfies ([38]) . must achieve both distortions with equality, i.e. 



lim 

n— >oo n 

k=l 
n 

I . 

lim 



-VE[(5i.fc -51,^)2] =Di, (47) 
fc=i 

- V E [(52.fc - 52,^)2] = Bl{p{). (48) 
fc=l 

Proof. That -D|(-Di) must be achieved with equality by any sequence of schemes achiev- 
ing {Di,D^{Di)), follows from Definition El of D^{Di). 

We now show that if Di satisfies (j38p . then also Di must be achieved with equality. 
As we next show, to this end it suffices to show that for all Di satisfying (j38p . the 
function D2{-) is strictly decreasing. Indeed, if D2{-) is strictly decreasing for all Di 
satisfying ([38j) . then a pair {D[, D2{Di)) for any Di satisfying ([38]) is achievable only if 
D[ > Di. Hence, any sequence of schemes achieving [Di,D2{Di)) with Di satisfying 
([38|) . must achieve Di with equality. 

It thus remains to show that for all Di satisfying (138p . the function -D2(')i which is 
illustrated in Figured is strictly decreasing. By Proposition 12.11 we have that 

£'l(i^2,min) = CF Ni + P ' ^ ' 

From (jUl) it follows that 



D^<-"^^^^^^) ^ (l^2*Pl)>^2,.in). (50) 

By the convexity of Si it follows that D2{-) is a convex function. This combines with 
(fSOll and our assumption that (f38]) holds, to imply that D2{-) is strictly decreasing in 
the interval! 

iVl + P(l-p2) 

where the interval's end point equals the RHS of ([38]) . □ 



^Let g: (a, c) ^ R be a finite convex function and let 6 £ (a, c). If 6 is such that 

x<h ^ g{x)>g{b), 

then g is strictly decreasing in the interval (a, 6]. Here we apply this with a correspondig to Di,min, 
with b corresponding to the RHS of (|38p. and with c — oo. This can be proved using [T] Corollary 
24.2.1 and Theorem 24.11. 
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a 



2 jV2+P(l-p2) 
N2+P 





Figure 2: Monotonicity of 



-Dl,min ^2JVi+P(lV) 



Based on Lemma IB.21 the proof of Reduction IB. II follows easily. 

Proof of Reduction \B . 1\ The reduction to optimal reconstructors is straightforward. 
Since every [D\,D2) G ^ is achievable, it is certainly achievable by some sequence of 
schemes with optimal reconstructors. 

It remains to prove that it suffices to limit ourselves to pairs {Di , D2 ) G & that 
are achievable by coding schemes that achieve Di with equality. To this end, we first 
note that by Definition 12.41 it suffices to prove Lemma IB. II for pairs (Di, Z?2(-^i)) ^ ^ 
where Di satisfies ()13p and ()38p . The proof now follows by Lemma lB.21 which states 
that for such pairs any sequence of schemes achieving (Di, L'gl-^i)) must achieve Di 
with equality. □ 

To continue with the proof of Lemma iB.ll we next derive a lower bound on ^2"^ 
(for finite blocklengths n). 

Lemma B.3. Let 0^"^ ^2"'') a coding scheme where and 4>'2^ satisfy 
Then, for any ai, 02 satisfying aia2 > 0, 



Lemma lB.31 relates the two reconstruction fidelities and - The difficulty in 
doing so is that if we consider a scheme achieving some at Receiver 2, then we can 
only derive bounds on entropy expressions that are conditioned on 82. However, for 
a lower bound on jj"^ we would typically like to have an upper bound on /(Si; Si), 
or /(Si;Yi) (without conditioning on S2.) To overcome this difficulty, we furnish 
Receiver 1 with S2 as side-information, and then prove Lemma lB.31 using Lemma lA.31 
and the following upper bound. 

Lemma B.4. If a scheme {f^"'\cl)^\cl)'^^) satisfies the orthogonality condition 



<5r>^(5r,ai,a2). 



(51) 



E (^i^A; - Si^k)Si,k = for every < k < n. 



(52) 
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then 



1 

n ^-^ L 



k=l 



s-(n)- 



Proof. The proof is based on the inequahty 



k=l 



(53) 



(54) 



which holds for every c G M because the scaled sequence cSi is a valid estimate of S2 
at Receiver 1. The desired bound now follows by evaluating the LHS of this inequality 
for the choice of 



where we have used the shorthand notation D2 for (^i"^)- Indeed, from 
(l55l) we obtain 



(55) 



and 



1 

- VE[(52,fc-c5i,fc)2 
fc=l 



k=\ 



k=l 



£7—2. 



a"^ -D*o 1 



") n ^ L 



S2,kSlk 



k=l 



+ a^-D. 



2) 



(56) 



where in the last step we replaced c by its explicit value and used the property that 



the normalized summation over E 
Rearranging terms in (j56p gives 

n 



5^^ equals a'^ — 6^^\ which follows from ([52]). 



1 / 

k=l 



□ 



We are now ready to prove Lemma IB. 31 

Proof of Lemma \B.3[ Denote by A^"^ the least distortion that can be achieved on Si 
at Receiver 1 when S2 is provided as side-information. The proof follows from a lower 
bound on ^2"'' as a function of A^"^ and from an upper bound on A^"^ as a function of 

We first derive the lower bound on To this end, let i?5^|52(0 denote the rate- 
distortion function on Si when S2 is given as side-information to both, the encoder and 
the decoder. Thus, for every < Ai < (7^(1 — p^). 



Rs,\s,{^,) = I log J ""'^^ 



(57) 



2 V ^1 

Since Receiver 1 is connected to the transmitter by a point-to-point link, 

ni?5,5,(Ai"))</(Si;Yi|S2). (58) 
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The lower bound on 5^'^ now follows from upper bounding the RHS of (j58p by means 
of Lemma \A.2>\ and rewriting the LHS of (|58p using ()57p . This yields 



> 



P + N2 



A 



(n) 



+ N2-N1 



(59) 



We next derive the upper bound on A\ by considering the distortion of a linear 
estimator of Si when Receiver 1 has S2 as side-information. More precisely, we consider 
the linear estimator 



S 



l,k 



aiSi,k + a2S2,k, ke{l,...,n}, 



where, as we will see, the coefficients ai, 02 correspond to those in Lemma [B.ll To 
analyze the distortion associated with Si, first note that by (j46p the orthogonality 
condition of (f52]) is satisfied. Since Si is a valid estimate of Si at Receiver 1 when S2 
is given as side-information, we thus obtain 




2a2pcr 



, 2 2 
+ a2(T 



. k=l 



a) 



+ 2aia2 [-Y.^[Sl,kS2,k\ 



, 2 2 

+ a2a , 



b) 



<a^ - ai{a^ - 5'^^){2 - m) - a2a\2p - 02) 



+ 2aia2\ (cr^ - (5[ 



(60) 



where in step o) we have used that the normalized summations over E[S'^^] and 

E [5*1^^52, fc] are both equal to cj^ — which follows by (j52p : and in step b) we have 
used Lemma lB.41 and the assumption that 0102 > 0. 

The lower bound on of Lemma IB. 31 now follows easily: Since the RHS of (|59p 
is monotonically decreasing in combining (160p with ()59p gives 



N2-N1 



' P + N2\^(6^-\a,,a2) ) 
where we have denoted by r/((5|"\ ai, 02) the RHS of ([60|) . 

Based on Lemma IB. 31 the proof of Lemma IB. II now follows easily. 



□ 



Proof of Lemma \B.1[ We show that for any nonnegative ai , 02 , the achievable distor- 
tion D2 is lower bounded by 

D2 > ^'(L>i, 01,02). 
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By Reduction IB . 1 1 it suffices to show this for coding schemes {/^""^j, {<Pi {(p2 } with 

0^"^ and ^2"^ given in (|l6|) and with associated normahzed distortions {^i"^}, {<52"^} 
satisfying 

lE^ = Di, and lEI 4"^ < D2, (61) 

n— ►00 n— >oo 

where Di satisfies (p8|) . By (f6T]) there exists a subsequence {n^}, tending to infinity, 
such that 

hm 4""^ = Di. (62) 

A;— >oo 

Hence, 

a) / 

D2 > lim 6r 

n—KX> 

> Ihi^ ^'(4"'\ai,a2) 

fc— >oo 

where a) follows from (j6ip : 6) follows from Lemma |B.3| and c) follows from (j62|) and 
from the continuity of ^'(5, 01,02) with respect to 5 — a continuity which can be 
argued from (j42p as follows. The function ^'(•) depends on 5 only through r/ (5, 01,02), 
and 77(5,01,02) is strictly positive for all P/Ni > and all 01,02, and it is continuous 
in 6 because, by (HOl) . D2{d) is continuous in 5. Hence, ^(•) is continuous in 5. □ 
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